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SEPARABLE CONVEX OPTIMIZATION PROBLEMS WITH 
LINEAR ASCENDING CONSTRAINTS * 

ARUN PADAKANDLA AND RAJESH SUNDARESANt 



Abstract. Separable convex optimization problems with linear ascending inequality and equality 
constraints are addressed in this paper. Under an ordering condition on the slopes of the functions at 
the origin, an algorithm that determines the optimum point in a finite number of steps is described. 
The optimum value is shown to be monotone with respect to a partial order on the constraint 
parameters. Moreover, the optimum value is convex with respect to these parameters. Examples 
motivated by optimizations for communication systems are used to illustrate the algorithm. 
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1. Problem description. Let g,„, m = 1, 2, • • • , L be functions that satisfy tlie 
following: 

• gm ■ (am,6m) — > K where am € [— oo,0) and bm G (0, +oo] and therefore 
am < < bm] 

• Qm is strictly convex in its domain bm)', 

• Qm is continuously differentiable in its domain {am,bm)', 

• The slopes of the functions at 0, i.e., the values of the strictly increasing 
function hm '■= g'm 0? ^ire in increasing order with respect to the index m: 

/ii(0) < /i2(0) < ••■ < /il(0); (1.1) 

• There is a point in the domain bm) where the slope of gm equals ^i(O), the 
slope of the first function at 0. (This may be equivalently stated as /ii(0) > 
hm{o-m~'r), given p.l|) and that hm is continuous and strictly increasing). 

In this paper, we minimize the separable objective function G : — > R given by 

L 

G{.y) 9nr{ynr), (1-2) 

m— 1 

where y = (j/i, • • ■ j^l), subject to the following linear inequality and equality con- 
straints: 

Vm G [0,/?™], m= 1,2,--- ,L, (1.3) 
^ym> ^am, ^ = 1,2,--- ,L-1, (1.4) 

m—l m=l 
L K 

m—l m—l 
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In the above constraints, we assume (3rn € (Oi^m] for m — 1,2, •• ■ , L, > for 
m = 1, 2, • ■ • , K, where K > L, and naturally, 

K L 
m—l m—1 

We also assume 

K 

^ am > 0. (1.7) 

m—L 

The inequalities in p.3p impose positivity and upper bound constraints. Note that 
if Pm = brrn the upper bound constraint is irrelevant because the domain of gm is 
{o-m-ibm)- The inequalities in (|1.4p impose a sequence of ascending constraints with 
increasing heights X]m=i indexed by I. Assumption (jl.6p is necessary for the 
constraint set to be nonempty. Without (|1.7p . it is easy to see that ?/l = 0, and the 
problem reduces to a similar one with fewer variables. 

What we have described is a separable convex optimization problem with linear 
inequality and equality constraints. A rich duality theory exists for such problems. 
See Bertsekas [T] Sec. 5.1.6]. Here, we provide an algorithm that puts out a vector that 
minimizes (11.21) and terminates in at most L steps. Section [5] contains a description 
of the algorithm and Section 0] the proof of its optimality. While we may take K = L 
without loss of generality, allowing K > L simplifies the exposition of our algorithm. 

Problems of the above kind arise in the optimization of multi-terminal communi- 
cation systems where power utilized, measured in Joules per second, is minimized, or 
throughput achieved, measured in bits per second, is maximized, subject to meeting 
certain quality of service and feasibility constraints. See Viswanath & Anantharam [5] 
for details and Section [3] for specific examples. Viswanath & Anantharam [2] provide 
two algorithms for their power minimization and throughput maximization problems. 
Our work unites their solutions and goes further to minimize any G that satisfies the 
constraints mentioned above. Under a further condition on the functions which will 
be stated in Section [51 we argue that our algorithm provides the solution to the above 
optimization problem with the additional ordering constraint yi > 1/2 > • • ■ > Vl- 

2. The Main Results. We begin with some remarks on notation. 

• For integers i,j satisfying i < j, we let p, j] denote the set {i,i + 1, ■ ■ ■ , j}. 

• Let Em := hjn{ (flmi^m) ), the range of hm- Thus the condition hi{0) > 
hmicim+),''n G [l,i] in Section [T] may be written as 

hiio) e ni^.Era- (2.1) 

• Denote by : E„, —^ {am,bm) the inverse of the continuous and strictly 
increasing function h„i- The inverse is also continuous and strictly increasing 
in its domain. 

• For convenience, define the functions iJ„j ; E,„ (flmi/^m] to be 

i/„ A/3™. (2.2) 

Hm is clearly increasing^ Assignments to the variable ym will be via eval- 
uation of Hm so that the upper bound constraint in (|1.3p is automatically 
satisfied. 

^We say / is increasing if a > fe implies /(a) > f{b). If there is strict inequality, we say / is 
strictly increasing. Similarly we use positive for > and strictly positive for > 0. 
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• For 1 < i < I < L, let 9l denote the least 9 > hi{0) that satisfies the equation 

I I 
^iJ™(0) = ^a„, (2.3) 

m—i m—i 

provided the set of such 6 is nonempty. Otherwise we say 0' does not exist. 

The domain of X)!ri=i f^m=i^m- The function X]L=i ^"i is increasing, 

and moreover, strictly increasing until all functions in the sum saturate. So 
there is no solution to (|2.3p when for example X]!ra=i ^ 12m=if^"^- 
general, if we can demonstrate the existence of 9 and 9, both in the set 
nJ^^jEm, that satisfy 

I I I 

m=i 7n=i m—i 

then the existence of 9\ £ nJ„^jE,„ is assured, thanks to the continuity of 
X]Li=i^™- Indeed, we may always take 9_ = /ii(0). This is because our 
assumptions (12. ip . and the increasing property of H^, m £ ll,L} imply 

III I 
J2 Hm {hM) <Y.^-^ {hmm = J2 ('*™ (^"(t^)) A /3m) - < ^ a^. 

m—i m—i m—i m—i 

The continuity and increasing property of X]'m=j: ^™ further imply that 

i9Ahi{0))<9\<9. (2.5) 

Thus, in order to show existence of 9\, it is sufficient to identify a 9 that 
satisfies the right side inequality of (|2.4p . We will have occasion to use this 
remark a few times in the proof of correctness of the algorithm. 

• Similarly, for 1 < i < j < i, we let 9^ denote the least 9 > hi{0) that 
satisfies the equation 

j K 

J2 Hm{9) = (2.6) 

m—i m—i 

provided the set of such 9 is nonempty. Otherwise we say does not exist. 
The difference between p. 31) and (|2.6p is the summation up to K in the right 
side of l|2.6p and the consequent difference in the upper limits on the left and 
right sides of (|2.6p . Hence the upper case Q\. The remarks made above on 
the existence of 9\ are applicable to O^ . 

• We now provide a description of the variables used in the algorithm for ease 
of reference. 

— n: Iteration number. 

— in and jn'- Pointer locations of the first and the last variables, y^^ and 
Uj^^, that are yet to be set. 

— N : The last iteration number in which a variable is set. 

— l,m : Temporary pointer locations that satisfy l^m £ \imjni in iteration 
n. 
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— t : Pointer to the variable that satisfies the corresponding ascending 
constraint with equaUty; t £ fimjn}- 

— ^„ : Choice of the best slope (marginal cost) in iteration n. 

— pm ■ Iteration number when variable ym is set. (This is needed only in 
the proof). 

~^ Cm '■ A label that indicates the type of that set the variable y,n. The 
possible labels are ^*} for Step 3(a) of the algorithm, {B*} for Step 
3(b) of the algorithm, and {C,C*} for Step 3(c) of the algorithm. If c„i 
is assigned an asterisked label, then the ascending constraint is met with 
equality for ym- (This is needed only in the proof). 
We now provide a generalization of the two algorithms given by Viswanath & 
Anantharam [5]. 

Algorithm 1. 

• Inputs: K,L,{ai,a2,- ■ ■ , a^), (/3i, /32, • ■ ■ , Pl) ■ 

• Output: y* = {yl,y2,--- ^vD- 

• Step 1: Initialization Set n ^ ^ ^ L and go to Step 2. 

• Step 2: Termination If i„ > j„, then set iV <— n — 1, output the 
vector y* = {y*i,yl, - ■ ■ , yl) , and stop. 

Else go to Step 3. 

• Step 3: Find Qj'^ > the solution of 02 . 6D with i <— i„ and j ^ jn- 
Also find 0\^^ for / £ Pn, in~ll- These are solutions of 02 . 3D for 
i <— in and I as chosen .□ Then set 

C„ = max {e^;; , h,,^ (0), el;ie j„ - 11 } 

• Case 3(a): If = 8:^" , then set 



Um ^ 


-^m (Cn 


) for m e 


|in I jn 


Pm ^ 


- n for 






Cm 


- A for 


m e {injn 


-11 


Ci„ ^ 


-A* 






in+l ^ 


- Jn + 1 






Jn+l ^ 


- jn- 






n 4- 


~n + l 







Go to Step 2. 



then 


set 




- 




- n 




- B* 


in+l 




jn+1 ^ 


- in - 1 


n <- 


- n + 1. 



Go to Step 2. 



^ Theorem [T] gives a sufficient condition when these quantities can be identified in every iteration. 



CONVEX OPTIMIZATION WITH ASCENDING CONSTRAINTS 



5 



for t = limjn ~ 1] > pick the largest such 



H,n for TO e lin,tj 

n for TO G [[i„, t] 
C for TOG fin, t — 1] 
C* 

t + 1 

jn- 

n + l. 

Go to Step 2. ■ 

Remarks: 

• Observe that in each iteration (i.e., a caU to Step 3) at least one variable is 
set. So the algorithm terminates within L steps. 

• The iterations are indexed by n where n e |1, N\. In each iteration, say n, the 
pointers i„ and j„ indicate the start and end variables that are yet to be set. 
At the end of this iteration, either all the variables are set (Step 3(a)), or the 
last one alone is set to (Step 3(b)), or the variables with contiguous indices 
|i„, t\ are set (Step 3(c)). The corresponding sets of labels are {A, A*}, {B*}, 
and {C,C*}, respectively. 

• Suppose y is the vector of production levels of L production units. Let 
represent the cost of operation for production unit m G [1,^], and G the 
overall cost. The production levels j/m set in a particular iteration are set to 
have the same marginal cost f„ , or are set to operate at capacity. In symbols, 
y*„i = Hm (Cp„ ) = (^p„. ) hPm- 

• Each iteration requires the evaluation of 0;^", and for I G [in,Jn — l]- 
These are zeros of continuous increasing functions. In Theorem [T] below, we 
provide sufficient conditions under which these zeros exist in each iteration 
step. 

• The question of evaluation of these zeros naturally arises. In the specific ex- 
amples in Section [3l we give closed form expressions for 0^" and . In gen- 
eral, this may not be available and one has to resort to numerical evaluation. 
However, the observation that the functions are continuous and increasing 
enables an efficient line search for the zeros. In the proof, we identify 9_ and 9 
on either side of the zero (see (|2.4p and (|2.5|) ) that narrows the search window. 

We now state the main result of the paper. 

Theorem 1. 7/6'',/ G - 1| and 9f exist, then the following hold. 

• For every iteration n with in < jn, the quantities Of' and 9\ ,1 \imin — ll 
exist. 

• Algorithm{Ii terminates in N < L iterations. 

• The output of Algorithm]^ minimizes under the stated constraints. 



Case 3(c) : If ^„ = 9l^ 
t and set 



ym 

Pm 
Cm 
Ct 
T-n+l 
jn+1 

n 



6 



A. PADAKANDLA AND R. SUNDARESAN 



We next state a simple corollary to this result which solves a related problem with 
additional constraints. 

Corollary 2.1. // the functions Hm satisfy Hi > H2 > • • ■ > Hl, then under 
the conditions of Theorem]^ the optimum y* satisfies 2/1 > 2/2 — ' ' ' — J/l- 

Remark We may use Algorithm [T] to solve the minimization problem with the 
additional constraints yi > j/2 > • • • > J/l if Hm is point-wise monotone decreasing in 
the index m. 

Before we state some properties of the optimum value function, we make some 
more definitions for convenience. 

• Observe that if K > L, the optimum value defined below depends on the 
if-tuple a S only through the L-tuple ^ai, ■ • ■ , ctL-i,J2m=L o^"*) ^ 
For studying the optimum value, we may therefore restrict our attention to 
K = L. Let a e and define C/ : ^ R U {+00} as follows: 

a ^ Qipt) inf {G{y) : y e R^ satisfies constraints pT^ - (fT3)) } 

We do not place the restrictions (|1.6p and (|1.7p on a; if the optimization is 
over an empty set the infimum is taken to be +00. Clearly Q > -co because 
it is the infimum of a strictly convex function over a bounded convex set, the 
set being defined by the constraints (|1.3p - (|1.5p . 

• Define a partial order on R;^ as follows. We say a ^ a if 



with equality when I — L. 

This partial order is stronger than majorization (see for example Marshall & 
Olkin 3J) in the sense that if a ^ a, then a majorizes a. Loosely speaking, 
a '(Z & indicates that the components for a are lopsided relative to those of 
a. The proposition below says that lopsidedness increases cost. 

Proposition 2.2. The function Q satisfies the following properties: 

• If Oi>a, then Q{q) > Q (a). 

• Q is a convex function. 

All the above results are generalizations of those of Viswanath & Anantharam 
[2]. The proofs are in Section 21 

3. Examples. We first consider a special case of an example from Bertsekas [TJ 
Ex. 5.1.2] that is of interest in optimization of communication systems. 

Example 1 (Vector Gaussian Channel). Consider L channels with noise vari- 
ances (T^, m G |1, L\. If power (> 0) is allocated to channel m, the throughput on 




m—l 



m—1 




Maximize the total throughput 




(3.1) 
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subject to a sum power constraint X]m=i Vm — P ■ 



The optimal allocation of powers is usually called "water-filling" allocation [4], Sec. 
f 0.4] because it levels the noise-plus-signal power -I- in the channels subject to 
the sum power constraint, possibly leaving out a few of the noisiest dimensions. We 
now arrive at this solution using our algorithm. 

Without loss of generality, we arrange the indices so that 

al<al<---<al. (3.2) 

Set gra{x) = - log {l + , [a,n,bm) = +oo), = -l-oo, K = L, a,n = for 

m € |1,L — 1], and = P- It is easy to verify that gmj^i £ [1,-^1 satisfy all the 
conditions laid out in Section [T] and that 

H^i0) ^ -e-' - (3.3) 

with domain E„i = (— c>o,0). Consequently, 6[, the solution to (|2.3p . is given by 



-I 



'^i-^i ^,^eIi,L-l], (3.4) 

and 

e[ = , . (3.5) 

Z^m=l "m ' ^ 

Theorem [T] therefore indicates that Algorithm [1] is applicable. 6[ and 8| are similarly 
identified for 1 < I < j < L. The ordering in (|3.2p implies that 8{ > ^5. f^^' 
/ G |1, j — 1]. An execution of Algorithm [T] therefore results in the following: identify 
the largest j such that Q\ > hj{0) — — o'J^, or equivalently, cr| < — l/9j, set = 

for m e IJ + and set y„i — H„i (^©i^ ior m G [1, j]. From p.3p . we see that 

y*j + o-^j = -l/O'j, the water level, for m e |1, jj. ■ 

Our second example is closely related to Example [T] and is from Viswanath & 
Anantharam [2]. It evaluates the sum throughput in a multi-user setting. Omitting 
the details of the reduction, we present only the mathematical abstraction. 



Example 2 (Sum Capacity). Let H3.S\) hold. Let 5,„(x) = - log + ,m G 

|1,L], as in Example]^ and let ai > a2 >■■■ > ax > 0. Minimize subject to 

the constraints in Section\^ 

The difference between Examples [1] and [D is that the ascending constraints now 
apply. Existence of 6*' , ^ G [1, L — 1] and Of follows as in the previous example (see 
(|3.6p below), and Algorithm [T] can be used to solve the minimization. Analogous to 
(|3.4p and (|3.5p . 9\ and 6^ are given by 



andO^ = — )^ (3.6) 

for l<i<l<j<L. At iteration step n, given and the assignment for is 
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explicitly given by 



-{l-in + l) 



1) -1 

. (3.7) 



Viswanath & Anantharam ^ give the same condition in terms of — 1/^„. The optimal 
allocation at this step sets either y*^ = indicating a rejection of the noisy channel 

index j„, or y*^ = Hm {^n), i-e., J/m + o'^n = ^^n^ foi' ^ contiguous set of channels 
starting from index i„. This optimal allocation thus partitions the channels into sets 
of contiguous channels, with each partition having its own water level. 

Remark Viswanath & Anantharam make an incorrect claim in [SJ Appendix A. 5] 
that the specific algorithm with ^„ set via p.7|) puts out the optimal y* whenever 

gm,n^ ^ [Ij -^1 are of the form gmix) = / ^1 + jS-j and / : ^ R is a continuous, 
increasing, strictly concave function. Their proof works only for some special cases. 
In particular, it works for f{x) = logx as in Example [5] above. The error in their 
proof can be traced to an incomplete proof for the case when L = 2 in 2, p. 1309]; the 
validity of their statement for L = 2 holds only in some special cases, f{x) = log(x) 
being one of them. Of course. Algorithm [T] with the correct ^„ based on the functions 
(7m, m G |1, L] will yield the optimal y* . ■ 

Our third example is also taken from Viswanath & Anantharam 2 and evaluates 
the minimum power required to meet a quality-of-service constraint. It serves to 
illustrate the use of Corollarv l2.1l The mathematical abstraction is as follows. 



Example 3. Let i3.S\) hold. Let : (— cxo, 1) R+ be defined as gmix) = 
Y3^,TO S [Iji]. Let ai > a2 > ■ ■ ■ > ctK- Minimize U.2\) subject to the constraints 
in Section[I\ and the additional set of constraints yi > y2 > ■ ■ ■ > Ul- 

Let us first solve the problem ignoring the constraint 2/i > 2/2 > • • • > J/l • Observe 
that [am, bin) — (— oo, 1) for all m and all the conditions outlined in Section [1] are 
satisfied by the given set of functions. Furthermore, it is easy to verify that = 
(0, oo) and Hm{0) = 1 — The quantities d\ and Of exist if '^m < I and 

J2m=i < L. More generally, for 1 < i < Z < j < L, 0' and 0] are given by 

/ I \ ^ 



and 



e 



Theorem [T] then assures us that Algorithm [T] yields the optimum solution. At iteration 
step n, given i„ and j„, the assignment for ^„ can once again be made more explicit 
and our algorithm reduces to the second algorithm of Viswanath & Anantharam. 
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Observe now that (|3.2p implies that Hi > H2 > ■ ■ ■ > so that the optimal y* put 
out by Algorithm [1] also satisfies j/i > 1/2 ^ ' ' ' — J/l • ■ 

Our final example illustrates the handling of the upper bound constraint. This 
is another special case of the example from Bertsekas [1, Ex. 5.1.2] that arises in a 
power optimization problem for sensor networks (see Zacharias & Sundaresan [5]). 

Example 4. Let gm{x) = ^x^,m e |l,i], K — L, = 0,m e \l,L - 1], 
ttL = a > 0, and £ (0, cxd) for m G II,-^]- Further, order the indices so that 
Pi ^ P2 < ■ ■ • < /3l- Minimize HI. 2(1 under this setting. 

Once again, all conditions outlined in Section [1] hold. It is easy to verify that 
Hm{d) = 9 A j3m- The function X)L,=i ^ piece- wise linear continuous function 

passing through the origin with slope I in (— cx),/?i), slope {I — 1) in (/3i,/?2), and so 
on, and zero-slope in (/3;,-|-oo). Clearly 6\ = 0, Z G [1,L — 1\. We assume that Of 
exists which is equivalent to a < X^m^i/^i- again. Theorem [1] assures us that 
Algorithm [1] is applicable. 

An application of Algorithm [1] results in the following. Identify the unique k such 
that a G [afc,afc+i) where 

k 

Uk {L - k)f3k + ^ f3m- 

m—l 

(It is easy to see that Ofc < 0^+1). Then 

IS,L _ ^ ~~ 'l2m=l P™ 
- T T. ■ 



Moreover, y'^ — Hm (Of') — Pm for m G |l,fc]. For m = Jfc + 1,L|, the values are 
suitably lowered from their upper bounds. Note that this assignment is completed in 
just one iteration of Algorithm [1] ■ 

4. Proofs. 

4.1. Preliminaries. We first prove some facts on the individual cases. 

Lemma 4.1. Suppose that in iteration n, the quantities Ol^,l G pn, jVi — 1] and 
Qj" exist. Suppose further that ^„ = hj^{0) and Step 3(h) is executed. Then the 
following hold. 

• The quantities 9\^_^_^,l G \in+i: in+i — 11 and 0^"^^ exist. 

Proof: Given that ^„ = /ij„(0) and Step 3(b) is executed, we see that in+i = in 
and jn+i = in — 1- We may assume in+i < jn+i] otherwise there is nothing to prove. 
Since the start pointer does not change and the end pointer decrements by 1, it is clear 
that e\^^^ = for Z = I 

in+iT jn+i ~ ll because and 9\^^ are zeros of identical 

functions for the indicated values of I. 

The question of existence now reduces to that of only O^"^^ (recall definition in 

(|2.6p ). First observe that if Step 3(b) is executed, we must have ^„ — hj^{0) > 6^^, 
and therefore 

= hj^' (V (0)) = hT^ > (e„) > H,^ (O^) , (4.1) 
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where the last inequahty follows because Hj^ is increasing. Consequently, we must 
have 



K K 



am = ^ ttm = ^ Hra j (from definition of 9^ 

n—in rrt—in 

rn—in 
3^-1 

< J2 (e^;^) +0 (from gU) 

m—in 



m—tn+i m—i-n. 



m— 



So we may take — Q-'^ in (|2.4|) . On the lower side, we may simply use ^ = ft.i(0). 
However, we can find a tighter bound from the following sequence of inequalitites 



E = E = E "™ (from definition of 0^;;-^ 



m—in m— ' 

< XI am ( from dni)) 



m—in 
K 



E 



i.e., we may take 6_ — Oj" in p.4p . 0^"+^^ therefore exists and 

c<et::<0t- (4-2) 

This establishes the existence part of the Lemma. 

To establish ^„ > we simply observe that ^„ is at least as large as all the 

candidates that determine Indeed, ^„ = hj^{0) > hj^^i{0) = /ij„_|_i(0). Next 

> 0^ = 9^^^ for I G [i„+i,j„+i - 11, and finally, C„ > 9^" > 6^;;+^^ by the right 
side inequality of (|4.2p . This completes the proof of the lemma. ■ 



Lemma 4.2. Suppose that in iteration n, the quantities 6\^,l G \imin — 11 and 
9^" exist. Suppose further that ^„ — 9\^^ for some t G \imin — ll, o,nd Step 3(c) is 
executed. Then the following hold. 

• ytn& [0,^m],m e |i„,il. 

• J2m=i V*m > J2m=i "m , ^ G with equality when I = t. 



jm—in — ^m—in 

• The quantities 0\^^_^,l G \in+iT jn+i — 11 and 9^^^^ exist. 



Proof: Note that in this case t is chosen to be the largest one in — 11 

that satisfies ^„ = 6\^. Step 3(c) is executed; therefore 9]^^ > hj^{0) > h,n{0) for 
m— limtj. The assignment for in the algorithm satisfies 

y*^ = Hra {9l) > Hra (/i™(0)) - h;^^ (/l„,(0)) A /3™ = A /3™ = 0. 
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That < (3m is obvious from the definition of ■ This proves the upper and lower 
bound constraints on y^. 

To show that the ascending constraints (with the sum starting from i„) hold for 
I = [in,il, observe that 6'-^ > and the increasing property of Hm imply 

II I I 

m—in Tn—in Tn—in Tn—in 

with equality when I = t. 

We next consider existence of Recall that in Step 3(c), in+i = t + 1 and 

jVt+i ~ in- Fix I £ |«n+i, jn+i — !]■ Wc simply set 9_ = hi{Q) in (|2.4p . Moreover, 

I I t 

m—in+i m—in m—in 

I t 
= ^ H,n {9lJ - Hm {0lj (from the definitions of and 

m—in m—in 
I t 

< ^ H„i (Oi^) — E ^™ (^L) (because Hm is increasing) 

m— i„ m— 
I 

E ^™(^ 



and therefore we may set 9 ~ in (|2.4p . ^'^^^^ therefore exists and 

/ii(0)<C+, <C- (4-3) 

The same argument (mutatis mutandis to account for the sum of am up to K) estab- 
lishes the existence of 0^"^^ and that 

hm<Qtl\<^t- (4-4) 

Finally, to show ^„ > in+i, observe that ^„ > hj^{0) = /ij„+i(0), > ©^^ > ^l^ti' 
and ^„ > > 9\^^^,l e p„+i,j„+i - Ij. The last two facts follow from ((i^ 
and (|4.3p . So ^„ is at least as large as all the candidates that determine ^n+i, i.e., 
> and the proof is complete. ■ 

Lemma 4.3. Suppose that in iteration n, the quantities 9\^,l G \in,jn — ll (ind 
exist. Suppose further that ^„ = 0^" . Then the following hold. 

• Vm^ [0,/3m],TO e p„, j„l. 

• I]m=j„ ^ I]m=i„ ^ = l^n, jn}, with equality when I = j„. 

Proof: Under the hypotheses. Step 3(a) is executed. The proofs of the statements 
are identical to the proofs of the first two parts of Lemma and is omitted. ■ 

Proposition 4.4. If 9[,l e ll,L - Ij and 9^ exist, the following statements 
hold. 

• For every iteration step n with in < jVi, the quantities 6^" and 9\^^l G 
{in, in - 1] exist. 
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• Algorithm]^ terminates in N < L steps. 

• The output y* of Algorithm{J\ is feasible. 

• In iteration N, Step 3(a) is executed. 

Proof: The key issue is the existence of 9^^ and 8^^ in Step 3 of each iteration. 
The hypothesis of this Proposition resolves the issue for n = 1. Lemmas 14.11 14.21 
and 14.31 resolve the issue for subsequent iterations via induction. The first statement 
follows. 

At least one variable is set in every iteration. The algorithm thus runs to com- 
pletion in < L iterations, and the second statement holds. 

The third and fourth statements also follow from Lemmas 14.11 14.21 14.31 and in- 
duction. 

We now argue that Step 3(a) is executed in the last iteration. If this is not the 
case, the last iteration must be Step 3(b). This implies zat = Jn and hjj^{0) > 6^^- 
The latter inequality and the definition of 0^™ yield 



K 



(e-)<v;(e-)<;^7„i(/.,„(o)) = o 



contradicting our assumption (|1.7p that X)m=L > 0. ■ 

4.2. Proof of Theorem [TJ Proposition 14.41 implies the first two statements of 
Theorem [TJ We now proceed to show the optimality of y* to complete the proof of 
Theorem [TJ 

We use the Karush-Kuhn- Tucker (KKT) conditions (see for example 1, Sec. 3.3]) 
to show that the vector put out by the algorithm is a stationary point of a Lagrangian 
function with appropriately chosen Lagrange multipliers. The Lagrangian function for 
the problem is 

E (-y™) + E (yr^ - 

E + E 1 ("^-^^ 





K 



m — 1 



where Am'' is the Lagrange multiplier that relaxes the positivity constraint —ym < 0, 

(2) . f3) 

Am relaxes the upper bound constraint i/m — Pm ^ 0, Am the ascending constraint 
p.4p . and /i the equality constraint p.Sp . The KKT necessary and sufficient conditions 



for optimality of this convex optimization problem are given 


by: 




>^iny,n = 0,m 


= 11,^1 


(4.6) 


iVm - /3m) = 0,m 




(4.7) 


\m— 1 m—1 / 




(4.8) 


A^V > 0, A(2) > 0, m = |1, LI and Af ^ > 0, ^ = 




(4.9) 


L-l 

hmiym) - XlV + A(2) - ^ A(^) - M = 0, m 


= 11,^1- 


(4.10) 
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Conditions (|4.6p . (|4.7p . and (|4.8p are the complementary slackness conditions, (|4.9p are 
the positivity conditions, and (|4.10p identifies a stationary point for the Lagrangian 
function. We now choose appropriate values for the Lagrange multipliers and verify 
the KKT conditions. 
First, let 

;^(i) ^ f - Cw, if Cm = B*, 
™ \ 0, otherwise. 

Recall that pm is the iteration number in which variable i/m was set, and that Cm = B* 
whenever Step 3(b) is executed, i.e., = 0. From the assignment in (14. lip . Am^ ^ 
implies that Cm ~ B* and therefore = 0. Thus the complementary slackness 
condition l|4.6p is satisfied for m = |1, i]. 
Second, let 

;^(2)^f0, ifc„=S*, 

™ i ip^ - hm{Hm{£.p„,)) , otherwise. 

If Am'' 7^ 0, then from (|4.12p we have ^ hm {Hm. (Cp„))- From the strictly increas- 
ing property of hm and the definition of Hm, we have 

hm {Hm (Cp™)) = hm [h^ iCp„J A /?„) = hm {hm (Cp™)) Aft-m (/3m) = Cp,„ A /im {Pm) , 

(4.13) 

so that hm {Hm (Cpm)) 7^ Cpm iiiiplies that _ffm (^p,„) must have saturated to Pm, i-e., 
= i/m (Cpm) = /3m- The complementary slackness conditions (I4.7P are therefore 

fulfilled. 

Third, for Z = Il,L- 1| let 

,(3)^ 1 Cp, -Cp., if^'=C% (4.14) 

' [ 0, otherwise, ^ ' 

where 

Pfe := min{pm : m G |l,L]l,Pm > P;,Cm e {C*,yl*}} . (4-15) 

The last iteration is always via Step 3(a) (Proposition [44]). Thus, when q = C*, 
there is a later iteration that executes Step 3(a) which implies that the set in (|4.15p is 
nonempty and that the assignment (|4.14p is well-defined. Suppose A^-* ^ 0. Then c; = 
C* , an asterisked assignment. The second statement of Lemma [4.21 therefore ensures 
that the ascending constraint is satisfied with equality for this I. The complementary 
slackness condition (|4.8p is thus fulfilled for Z = |1, L — 1]. 

The assignment of Ap"* in (|4.14p can be equivalently expressed as 

' \ 0, otherwise, 

where pk is given by (|4.15p . This will be useful in verifying (|4.10p . 
Finally, we set n — ^n- 

The Lagrange multiplier assignments in (|4.1ip . (|4.12p . and (|4.14p are positive. 
Indeed, the positivity in (|4.1ip and (|4.14p follow from the monotonicity property 
> £,n+i,n ~ — 1]^ (Proposition The positivity of Am follows from 

hm {Hm {^pj) < hm {hm' (Cp™)) = Cp™ • 
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All that remains is to verify (|4.10p . To do this, first consider m > j^. Then 
the assignments 2/^ — ^^'^ Hi ~ 0,1 — ["^ + 1, ^ 1] are via Step 3(b); therefore 
Cp, = hi{0) and ci ^ B*. The latter implies A^' = £,p^ - £,n, A^^ = 0, and Af ^ 
for I — Im, L — l^. Substitution of these assignments in (|4.10p yields 

L-l 

KM - A(i) + xl^J - J2 - = Cp,„ - (Cp™ - ^iv) + - - e« = 0. 



l—m 



Now consider m £ |l,iAr] and p,„ < N, i.e., variable i/m is not set in the last 
iteration. Then c,n G {C,C*}, and thus c,n ^ B* . Substitution of ()4.11|) . (|4.12p . and 
(1414]) in (liTO]) yields 



L-l 

(3) 



— 


{Hm (Sp, 


J)-o + (^p„- 






L-l 




, -ew- 


/— m 








= ?p™ 


, -e^- 








n— 


= ^p™ 






= 0. 







(4.17) 
(4.18) 



In the above sequence of inequalities, (|4.18p holds because of the following. In (|4.17p . 
the summation over / has only one nonzero entry per iteration, i.e., whenever q = 
C* . We may therefore sum over the iteration index n instead of the variable index 
I. Iterations Pm to TV — 1 involve the execution of either Step 3(b) or Step 3(c). 
Substitution of (|4?T6l) in ((4T7)) then results in ((4T8)) . 

Lastly, consider m G [1, Jat] andpm = i.e., is assigned in the last iteration. 
From Proposition 14.41 Step 3(a) is executed in this iteration, and therefore Cm & 
{A, A*}. Then 

L-l 

/i™(2/™)-A«+A(2,)-EAP^-M 

l — m 

= hm {H„, i^pj) - + (Cat - /i™ (ff™ (ep„J)) 

The output y* of Algorithm [1] and the Lagrange multiplier assignments satisfy 
the KKT conditions; y* therefore minimizes (11.21) . and the proof of Theorem [1] is 
complete. ■ 

4.3. Proof of Corollarv I2.ll The assignments in Algorithm [1] are 

J/m = H,n (Cp„J ,m = [1,L]. 

By hypothesis, H,n > iJ„i+i,TO G |l,i — Ij, and by Proposition 14. 4i ^„ > £,n+i,n G 
[1, — 1]. These monotonicity properties imply 
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4.4. Proof of Proposition 12.21 : Recall that here K ^ L. Define 

C{a) := {y eM.^ -.y satisfies dO]) - (HH)} . 

C{a) is convex, but may not be closed because the domains {am,bm) may not be 
closed. From the ascending constraints (|1.4p and (|1.5p . it is clear that if a ^ a then 
C{a) C C{a), and therefore G{ct) > The first statement is therefore proved. 

(Note that the conditions on g„i, m G |1, i^] stated in Section [T] are not necessary for 
this property). 

To show convexity, consider a, (5 G M.^. Fix A G (0, 1). If either of C{a) or C (a) 
is empty, there is nothing to prove. We may therefore assume both are nonempty 
and therefore Gia) and G (a) are finite. For every e > 0, there exist y G C{a) and 
y G C{a) satisfying G{y) < G{a) + £ and G{y) < G {&) + e. The linearity of the 
constraints implies Ay + (1 — A)y G C (Aa + (1 — X)a). The convexity of G implies 

G {\a + (1 - X)a) <G{Xy + {l- \)y) 

< \G{y) + {\ - \)G {y) 

< XG{a) + {l-X)G{&)+e. 

Since e is arbitrary, the convexity of G is established. ■ 
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